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Paper-Pencil  Laboratory  Tests  and  their  Relationship  to 
Various  Achicvciucnt  hcasurcs  in  Physics 
Hayn  Kru^lak 
University  of  uinnesota 

Abstract 

This  report  deals  with  the  analysis  of  paper-pencil  laboratory  test 
scores  in  general  ph^'sics,  constructed  and  adninistured  at  the  University 
of  Minnesota,  1952-53*  The  characteristics  of  the  tests  were  investigated 
aiid  the  relationships  with  othc  r achievenont  i.ieasures  were  explored. 

It  was  found  that  the  paper-p.  ncil  tests  designed  to  neasure  specific 
'■  .structienal  objectives  had  a nornal  distribution  over  a much  narrower 
range  of  scores  than  the  laboratory  pcrfornance  tests.  The  Davis  discrim- 
ination indices  for  the  items  were  highest  with  the  total  score  on  each 
test  a.':  - '^rit-c.  'ion,  but  the  aver-’pe  index  was  Irw  for  every  test.  The 
p'jint  biso.  ’.ai  correlaticns  with  the  performance  items  tended  to  cluster 
about  zero.  In  general,  the  Hoyt  rcl  abilities  were  on  the  low  side  and 
vrore  comparable  in  valiac  to  tjic  r'liabilitics  of  the  performance  tests. 

The  items  had  fairly  high  face  validities  as  based  on  the  avera^ c of  four 
exyicrt  ratings. 

h'ith  the  exception  of  the  Identificration  and  Function,  pre-test  intor- 
correlations  were  l:r.v.  These  two  pre-tests  v/ere  fair  predictors  for  the 
corresponding  post-tests  in  ..cchariics,  .11  the  pre-tests  in  Electricity 
’wore  fair  predictors  for  the  corresponding  prast-tests.  The  correlations 
between  the  paper-pencil  tjsts  and  other  criteria  of  ajhi.cvencnt  in  ele- 
mentary physics  Wwrc  either  non-significantly  diif,.rc:it  fren  zero,  or  low. 
On  thr.-c  of  the  four  tests  ir:  • cchanics,  boys  scored  significantly  higher 
than  th-j  girls.  On  Oxll  the  post- tests  th'-  means  were  sigiaificantly  higher 
than  for  the  pre-tests,  irrespective  of  sex  or  course  taken. 
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The  investigation  lends  support  to  the  hypothesis  that  paper-pencil 
laboratory  tests  contain  clenents  otl::r  than  those  evaluated  by  pcrfomance 
tests  and  the  con\-ent:  inal  noasiires  of  achievenent  in  elementary  physics. 


Paper-Pencil  Laboratory  Tests  and  their  Relationship  to 
Various  Achievenent  lleasurcs  in  Physics 
liic  purpose  of  thj.s  report  is  to  describe  an  investic^ation  dealing 
■with  pa.pcr-pcncil  tests  for  the  oleniontary  physics  laboratory, 

Characterj sties  of  paper-pencil  laboratory  tests  in  Mechanics 
During  the  fall  quarter  1952-53  four  tests  in  Mechanics  were  adjnin- 
istered  as  pre  and  post-teststo  students  c-jirollcd  in  the  general,  non- 
technical Physics  1 and  la.  The  tests  -were:  Identification  of  Apparatus, 
Function  of  Apparatus,  lixperinonts,  and  Ldsccllaneous,  The  details  of 
tost  construction,  adninistration  and  the  frequency  distributiojis  of  the 
scores  vrcre  given  in  the  preceding  report  (U),  It  v;as  thought  desirable 
to  subject  the  data  to  a more  detailed  analysis, 

Mornality  of  Score  Distributions, 

The  scores  for  the  pre  and  post-tests  v/cr..  o.vprcsscd  as  cumulative- 
percentages  and  plotted  on  probability  graph  paper.  The  percentile  ranges 
of  normality  for  the  boys  and  girls  in  the  two  courses  arc  shown  in  Table  1, 
The  values  in  the  table  correspond  to  th>_  points  ■which  fall  on  or  very 
close  to  a straight  line. 


Tabic  1 

Percentile  range  of  normality  of  paper-pencil  laboratory  tests  in  i.cchanics. 


Test 

___Phy3 

ics  1 

Physics 

la 

N 

Poys  , 

^ H 1 Girls 

N 

Boj-s 

Girls 

Identification 

Pre 

72 

1-95  i 

l/i6|  20-99 

145 

2-75 

21 

15-75 

C10-U0;i 

1 blO-60; 

r 2-25; 

Post 

30 

150-55  i 

j 21-^75-98 

6ii 

|55-9o1 

6 

1 

Function 

Pro 

72 

5-75 

U6'  25-75 

IhS 

1-99 

21 

7-93 

Post 

33 

35-95 

(19;  25-55 

65 

15-75 

7 

F.xporiments 

Pro 

72 

5-35 

iii6i  10-90 

Iii5 

15-90 

21 

2-80 

Post 

32 

25-75 

1 

! 21i  2^-95 

6ii 

1-75 

6 

Miscellaneous 

Pro 

72 

10-85 

1 

li6  25-90 

1U5 

15-80 

21 

20-90 

Post 

33 

10-80  1 
1 

19  10-90 

65 

15-30 
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For  tho  pre-tests  the  scores  were  normal  in  the  interquartile  range 
( 25-75/5) • In  most  cases,  hnvravcr,  normality  was  evident  over  a much  wider 
range,  ’7ith  the  eycoption  of  the  Identification  test,  the  post-test  scores 
appeared  to  bo  normally  distributed  over  approxiiaately  the  sane  ranges  as 
the  pre-test  distributions*  The  Identification  post-tost  scores  appeared 
to  bo  typical  of  binodal  populations. 

Other  trends  which  were  apparent  from  tho  graphs  can  be  suim’arized 
as  follows: 

There  were  practically  no  differences  in  the  test  score  distributions 
between  boys  in  Physics  la  and  boys  in  Physics  1.  The  same  was  true  of 
the  girls  in  the  tvro  courses. 

The  scores  of  the  girls  in  Physics  1 on  the  Identification  and 
Function  post  tests  wore  below  tho  boys'  distributions  on  the  correspond- 
ing pre-tests, 

Tho  gains  from  the  Identification  pre  to  post  scores  w>,i-o  vury  much 
greater  for  Physics  la  b lys  than  for  the  boys  in  Fh/siCvS  1,  This  tendency, 
although  present,  v<ns  not  quite  as  pronounced  for  the  other  test  . 

The  scores  on  the  tioporiments  pre-tests  ivere  about  the  sane  for  boys 
and  girls  in  both  courses,  with  a fairly  large  nueber  of  negative  scores. 
The  gains  from  tho  Experiments  pre  to  post-tests  v/orc  in  general  snail. 

Several  tentative  hypotheses  were  suggest',  d by  tho  exanination  of 
the  score  distributions: 

1.  Toys  have  significantly  higher  scores  than  girls  on  pre  and 
post-tests,  with  the  exception  of  the  .more  difficult  tests, 

2.  Students  with  and  vnthout  laboratoi'y  •.v'ork  gain  significantly  fron 
pro  tests  to  post-tests, 

3.  The  students  vdth  laboratory  instruction  rain  somewhat  more  from 
pro  to  post-tests  than  students  without  laboratory  work. 
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li.  The  Experiments  tost  is  probably/difficult  for  students  at  the 
level  of  Physics  1 and  la. 

The  results  for  126  boys  on  the  laboratory  porfon/ancc  test  in  Physics 
la  wore  also  plotted  on  probability  paper.  Tne  points  fell  on  a straight 
line  in  the  5 to  95  oercentagc  range  and  wore  not  far  from  the  line  at  tho 
2 and  98  percentiles.  Thus,  performance  tost  scores  exhibit  a ucmality 
over  a much  wider  range  than  any  of  the  paper-pencil  post- tests.  The 
performance  test  is  reproduced  in  the  Appendix, 

Coiaparison  of  Variances  and  r'e-ans 

The  means,  variances,  standard  deviations,  P-rat'.os,  and  t-values 
for  the  pro  and  post-tests  are  reproduced  in  Taole  I of  the  Appendix,  An 
inspection  of  the  table  ruv-^als  a nunber  of  facts: 

1,  Out  of  tno  eight  F-ratios  for  boys  and  ^irls  v^ho  took  the  pre-tests, 
three  vrcre  significant. 

2,  The  difference  in  the  means  of  boys  and  girls  were  significant  in 
both  cours-s  for  the  Identification,  Function,  and  hiscellaneous  pre-tests. 

3«  The  differences  in  the  ;.K.ans  of  the  boys  .and  girls  were  significant 
in  both  cmersos  f-r  tiiO  Id'r.tifi''aticn  pcst-tost, 

ii.  The  difference  in  the  muins  of  boys  and  girls  v:as  significant  in 
Physics  la  for  ‘.ho  Kxperinuiit?  prG-t».st  and  th>..  iiisceilaneous  post-test, 

5.  There  were  tv.rj  si-gnificant  F-ratios  for  students  in  Physics  1 
and  Physics  la;  on  tiio  nxoeri. i-nts  pro-t^st  for  both  boys  and  girls. 

6,  The  diffcrc..ccs  b'-tv.'.;en  the  means  of  students  in  Physics  1 and  la 
v;orc  significant  for; 

a,  bo./s  and  girls  on  th«.  Identification  post-test 

b,  girl.s  on  the  iiiscellancous  pro-tost 

c,  boys  on  the  Experiments  post-test 

?.  The  initial  knov;ledge  as  measured  by  the  Experiments  pre-test 
G The  .Statistic.al  .i.pp>,ndix  is  available  on  request  from  the  author. 


and  the  final  achievement  expressed  by  the  post-test  score  on  the  same 
test  ■were  very  low  for  all  groups. 

A similar  analysis  was  jnade  for  students  who  completed  the  pre-tests 
as  well  as  the  post-tests.  The  results  are  shov/n  in  Table  II  of  the 
Appendix,  The  size  of  the  sampl'-S  was  thus  reduced.  One  could  observe 
that: 

1.  The  difference  betvreen  the  moans  of  boys  and  girls  in  Physics  la 
became  non-significant  on  the  Experiments  post-tost, 

2.  none  of  thv,  F~ratios  vrcre  significant, 

3.  The  mean  of  the  boys  in  Physics  1 bocanc  significantly  higher 
than  the  :?.ean  of  the  boys  in  Physics  la  on  the  Identification  pre-t^st, 

h.  There  v;as  no  longer  significant  differences  in  the  means  of  the 
girls  in  both  courses  on  the  Iliscollaneous  pre-test. 

Table  II  alvso  compares  the  g ains  from  the  pro  to  post- tests  for  the 
groups.  It  v;as  fo'ond  that  vfith  the  exception  of  girls  in  rhysics  la, 
on  the  Iliscollaneous  test  all  groups  made  significant  gains  on  all  the 
tests,  Hoy/over,  th'-  sample  of  girls  in  Physics  la  vfho  took  the  post- 
test  vras  extremely  snail. 

The  data  from  Tables  I and  II  seoixd  to  support  several  conclusions 
with  respect  to  pencil-paper  laboratory  tests  in  Lechanics: 

I,  There  ■wore  significant  differences  betv/cen  the  means  cf  the  boys 
and  girls  on  the  Identification,  Function  and  iiiscellancous  prc-tosts,  in 
favor  of  the  boys.  This  vns  true  of  both  courses, 

II,  There  were  significant  differences  bctw'een  means  of  the  boys  and 
girls  on  the  Identification,  Function  and  .Miscellaneous  post-tests, 

III,  Both  sex  .3  shovxd  significant  gains  in  the  means  from  the  pre 
to  the  post-tests  in  both  courses, 

IV,  The  effect  of  laboratory  training  appeared  to  be  most  pronounced 
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in  the  case  of  the  Identification  test,  vrith  students  in  the  laboratory 
course  haviiig  significantly  higher  means  than  the  students  in  the  no- 
laboratory course.  The  trend,  though  present,  was  less  narked  for  the 
Function  and  Experinents  tests,  Ihc  differences  va^re  negligible  for 
the  Miscellaneous  test. 

The  Reliability  of  the  Tests 

The  reliability  of  each  pro  and  post  test  vns  calculated  by  the 
Hoyt  ueti'.od  (2)  for  boys  and  girls  in  both  courses.  The  rcliabilit/ 
coefficients  are  reproduced  in  Table  III  of  the  Appendix,  The  highest 
reliaViility  obtained  ras  ,?8  for  the  , iscellaneous  post-tost  for  girls. 

The  lowest  coefficients  wer^.  characteristic  of  the  Experinents  pru  and 
post-tests.  It  is  probable  that  the  difficulty  of  this  p<articula.r  t_st 
caused  the  students  to  engage  in  a great  deal  of  vdld  guessing,  tho.  gh 
they  have  been  warned  not  to  do  it. 

Item  Analysis 

Oavis  Indices 

Four  criteria  were  used  vdth  tho  Davis  technique  (1)  of  item 
analysis  for  physics  la;  the  total  score  on  each  test,  the  total  score 
on  the  laboratory  perfomance  tost,  the  final  exaninatinn  grade,  and 
the  final  course  grade.  Students  in  Physics  1 had  no  performance  score, 

TliO  discrimination  and  difficulty  indices  ar^  shov.na  in  Tables  IV-XI  of 
the  Appendix,  On  the  basis  of  the  data  several  trends  were  ovid^  it: 

1,  Tho  hi, .host  discrimination  indices  for  a given  Uist  ivcrc  obtained 
when  the  total  scor..  was  used  as  a criterion*  This  ’.vas  true  of  both  courses 
and  both  sexes,  Hovfcvor,  since  thv.  Physics  1 groups  wore  small,  one  must 
accept  all  conclusions  cautiously.  The  indices  ranged  from  0 to  7h; 
the  average  valu..s  vfcrc  from  15  to  32, 


The  remaining  uhrec  criteria  yielded  a large  number  of  negative  and 
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positive  discriiniivition  indices  of  low  values,  vdth  the  avorf>^c  indices 
ranging  from  3 to  l8  for  Physics  la  and  fron  -11  to  ? for  Physics  1. 

2,  The  average  difficulty  indices  wore  of  the  sane  order  of  mgnitude 
for  all  the  criteria  on  a given  tost.  They  weri-  soncwliat  higher  for  boys 
than  for  girls;  a little  higher  for  Physics  la  than  for  Physics  1, 

The  average  difficulty  indices  were  very  much  low^r  for  the  Experin^nts 
test  than  for  the  other  toots  for  both  boys  and  [.iris  in  the  tv/o  courses. 

On  the  basis  of  the  Davis  analysis  it  was  reasonable  to  hypothesize 
that  the  itens  on  the  paper-pencil  laboratory  tests  would  not  discrininate 
effectively  betyreon  the  good  and  poor  students  in  physics  as  defined  by 
their  rank  on  conventional  achievenont  neasurcs  and  laboratory  pcrfoiTiancc 
tests. 

Point  Biscrial  Correlations  v/ith  Pcri'on:iancG  Tests 

Point  biscrial  correlation  coefficients  were  computed  between  each 
item  on  the  perfomance  test  and  each  item  on  the  ,>apcr-pcncil  laboratory 
tests.  The  coefficients  cire  shovai  in  T'ble  ZII  of  the  Appendix#  It  can 
be  seen  that  the  majority  of  the  values  are  low,  clustering  around  zero. 

The  highest  coefficient  vmis  ,50;  -.Wi  was  the  coefficient  with  the  high- 
est negative  value.  There  7/urc  26  coefficients  with  absolute  value  ,30 
or  higher  out  of  53U  possible  comparisons. 

On  the  basis  of  the  low  values  of  point  biserial  correlation  co- 
efficients it  is  reasonable  to  propose  a tentative  hypothesis  of  non- 
significant relationships  between  the  relatively  complex  laboratory 
purfo.rrance  ite  s and  papor-ooncil  itor.s  designed  to  cover  specific 
obj>-ctivcs  of  laboratory  instruction. 

Judges*  Ratings  of  Items 

The  four  judges  v/ho  rated  the  performance  items  (3)  also  evaluated 
the  paper-pencil  items  in  turns  of  their  suitability  for  appraising  lab- 
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oratory  instruction.  Tho  judges*  ratings  aro  reproduced  in  Tabic  XIII  of 
the  Appendix. 

There  vns  only  one  iten  that  had  an  average  rating  fron  poor  to  fair. 
All  tho  other  iter.s  were  rated  as  fair  or  good,  . substantial  nur.ibcr  of 
itons  had  the  top  rati.  g fron  all  tho  judges,  Tvad  of  the  jud^^es  had 
approximately  the  sano  average  rating  for  the  items  on  each  tost;  one  judge 
vns  a more  severe  critic  than  the  others;  the  fourth  judge  vvas  relatively 
easy  to  please.  For  most  of  the  itons  the  difference  bctv.’ccn  the  ratings 
was  not  greater  than  one  point, 

Tho  ratings  indicated  that  most  of  the  test  items  had  a good  face 
validity. 

It  is  interesting  to  note  that  the  ratings  apjx;arcd  to  have  no  re- 
lat.’.onship  to  the  point  biserial  correlation  coefficients.  The  ratings 
of  the  pcrfomancc  items  aro  also  shovm  in  Table  XIII. 

Correlations  Between  th<-  Paper-Pencil  Laboratory  Tests  in  Mechanics 

Pre-test  I.it^rcorrelati oas 

Tho  correlation  matrix  for  the  laboratory  papcr-pcncil  pr^-tosts 
is  reproduced  in  Tabic  2,  The  highest  correlation  coefficients  were 
between  the  Identification  and  Function  pre-tests,  for  boys  and  girls 
in  Physics  la  and  for  boys  in  Physics  1,  The  correlations  v^crc  also 
significant  for  boys  in  Physics  la,  between  the  Identification,  Function, 
and  tho  other  pre-tests,  Hov/ovor,  tho  values  of  the  coefficients  were 
low.  It  is  quite  .apparent  that  the  Identification  and  Function  pro- 
tests hav.j  some  elei.;.„nts  in  common,  Anoth..r  possiblity  is  that  a 
knowledge  of  th.^  name  of  the  appar.atus  suts  up  some  r.i_ntal  associations 
vAich  help  to  recall  its  function. 


Table  2 


Correlation  matrix  of  laboratory  v/ritten  pre-. tests 
University  of  , innesota,  fall  quarter,  1952-53. 


Course 

Physics 

N 

Variables 

Correlation  Coefficients 
X7  X0  X9 

B G 

B 

G 

B 

G 

la 

123 

13 

0m 

Identification 

.57*^'  .59^^ 

.18* 

.05 

.33** 

-.09 

o 

of  appairatus 

1 

58 

39 

^6 

.51^  .32* 

CJ 

0 

• 

1 

• 

.U2** 

,21 

la 

123 

13 

X? 

Function 

.35** 

.21 

.39** 

-.09 

of  apparatus 

1 

58 

39 

'=7 

.07 

.-09 

.12 

.07 

la 

123 

13 

^8 

- 

Experiments 

.05 

.22 

1 

58 

39 

^8 

.25 

.02 

X, 

- 

i.iscellaneous 

Significant  at  the  1%  level  ^ B-boys 

^Significant  at  the  level  G-girls 

Post-tost  Int  .rcorr-.l'itions 

Limited  testing  ti.  .o  allowed  for  the  post  tosts  p^-mittod  the  admin- 
istration of  only  two  t^-sts  to  on-j  subsar.iplu  and  th-  reoiaining  t'.\o  tests 
to  anothv^r  subsample.  For  62  boys  in  Physics  la  who  took  th^  Identifica- 
tion and  Exp^^rir.iunts  post-tests  the  corrclatiens  bctv/con  th^.  tv.m  vr.s  .20, 
not  significantly  diff-jrent  from  zero;  for  th^.  corresponding  pr.  -tusts 
the  value  of  the  corr^,lation  coefficient  vras  .18,  It  is  q"lte  likely 
that  the  tw  t^sts  ;,';>_asure  diff^-roiit  asp«_cts  of  laboratory  v/ork.  For 
the  60  boys  in  Physics  la  who  took  the  Function  and  hisccllaneous  post- 
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tests  the  correlation  botvircen  the  two  was  ,145}  for  the  corresponding  pro 
tests  th^.  value  was  ,39.  The  1-iiscellaneous  test  dealt  ivith  the  relation- 
ship between  the  v riexis  components  of  an  apparatus  and  with  the  sclec- 
tioi.  of  .appropriate  ueasureng  instruj.ient,s.  Consequently,  a positive 
correlation  with  the  Function  test  was  to  be  expected. 

Correlations  Between  Pro  and  Post  Tests 
The  correlation  mtrix  between  the  laboratory  paper-pencil  pro  and 
post -tests  is  shown  in  Table  3.  For  boys  in  Physics  la  the  correlations 
between  the  four  pre-t.sts  and  the  corresponding  post  tests  were  positive 

and  significant,  but  the  coefficients  for  the  Identification  and  Function 
vryr^ 

tests/rnuch  higher  than  for  the  remaining  two  tests.  For  boys  in  Physics 
1 the  only  significant  pcisitivc  correlation  between  a pr^-test  and  a 
corresponding  post-t^st  'A-as  obtained  for  the  Functions  test.  For  girls 
in  Physics  1 the  significant  and  positive  correlations  were  for  the 
Function  and  iLrcncrimcnts  pro  and  pa>st-tests. 

The  intcrcorrclations  betr/een  the  pre-tests  and  the  Experiments 
post-test  V4crc  in  general  lev:  and  nonsignificant.  The  difficulty  of  this 
tiist  had  boon  mentioned  as  a possible  explanation. 

The  into r cor re la ti. ms  between  tho  pr^-t^sts  and  idsccllancous  post- 
test wore  also  lov4  and  in  most  eases  nonsignificant. 

In  general,  the  corrolati-ms  for  girls  in  Physics  1 were  low  and 
nonsignificant.  It  is  difficult  to  explain  the  relatively  high  value 
(,55)  of  the  correlation  between  the  Exnerir.i^nts  pre  and  post-test  in 
the  case  of  girls  in  Physics  1;  also  betwe-i^n  the  Liscellaneous  pre-test 
.and  Idontificati.Dn  pist-t^st  (.57)  for  boys  in  Physics  1,  Unfortunately 
the  sample  of  girls  who  conpletjd  Physics  la  wr.s  too  small  for  valid 
comparisons* 
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Table  3 

Correlation  natrix  of  laboratory  papor-ucncil  pre-tocts  and  poSt-tcats, 
UnivvTsity  of  pinnosota,  fall  quarter,  1952-53* 
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X.  Tdcntificati.'ii  ’or--t(:st 
o 

Identification  post-test 
JiD 

Function  pre-t^st 
Xfi  F’anction  post-test 


V 

r» 


o 


^13 


Focoorir.icnts  pre-test 
Experinents  post- test 
. iscelianeous  pro-test 
iscollaneons  post-test 


^Significant  at  the  1^,  level  ^*’Sii-;nif leant  at  the  level 

I lubso.)  .el  - coiapleted  Identification  and  iixperiiaent  post-tests 

II  Subsai.iple  II  - completed  Function  and  liiscellanoous  post-tests 
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The  conclusi  m3  based  on  th..  data  wore: 

1.  The  Identification  pro-test  is  a fair  predictor  of  the  post-tost 
snore  for  boys  in  Physics  la;  the  saree  pre-test  is  a good  predictor  of 
the  Function  post-tvist  scor>-, 

2.  H’le  Function  prc-t>_st  is  a fair  predictor  of  the  F'onction  post- 
test scores  for  boys  in  both  courses  and  for  girls  in  Physics  1 • The 

effect  of  laboratory  work  is  l^'ast  evident  in  this  particular  area, 

or 

3.  The  Experinonts  and  Liscellancoi's  pre-tests  are  pocr/v;orthless 
instrur.cnts  for  predicting  any  of  the  post-t^st  scores,  particularly  in 
Physics  1,  the  cours  - v/ithout  laboratory. 

ii.  The  effect  of  laboratory  instruction  could  bi-  discerned  in  the 
noderately  high  values  of  the  coefficients  between  the  Identification  pre- 
test •'.nd  Function  post-test  and  th-  conversv.  for  boys  in  Physics  la.  This 
effect  was  not  observed  for  b:/s  in  Physics  1, 

Correia  ti> ns  Detwecn  Paper-Pencil  Laboratory  Tests  and  Other 
AchieVeHwnt  r..oasures  in  Physics 

Each  of  the  pre  and  post-teSts  was  correlated  with  the  following 
scores:  quiz  average,  final  exaninatim,  final  course  grade,  laboratory 
grade,  and  laboratory  perf^manco  test.  The  I'Csults  are  suaaarized  in 
Table  U. 

The  outstanding  fact  characteristic  of  the  analysis  is  that  no  t of 
the  correlation  coefficients  are  low  in  value  and  not  sigi'dficantly 
differeit  frou  zero.  This  is  particularly  true  of  the  girls  in  both  courses. 

Another  striking  feature  of  the  tabulated  data  is  the  absence  '^f  a 
single  significant  correlati  n coefficient  for  boys  in  ..  Physics  1, 
i.'ost  of  the  significant  correl'-tions  were  for  boys  in  Physics  la,  but 
the  values  were  low;  ,37  was  th.;  highest  positi^^e  coefficient;  -,h3  vr?.s 
the  1 west  negative  value . 

The  one  consistent  set  of  c >rrelcatiou  coefficients  v:as  obtained  for 


Tabic  h 


Correlation  matrix  of  laboratory  paper-pencil  tests 
and  other  achiovonent  m-.asuros  in  elcn.ontary  physics. 
University  of  Ilinncsota,  fall  quarter,  .1952-53 


Correlation  Coef 

ficients 

w. 

Boys  Girls 

1 Variable 

s Xi 

X2 

^3 

® \ 

% 

B 

G B 

G B 

G B G 

B G 

la 

123  13 

^6 

-.28*^ 

-.13  .13 

.a  -.21 

-.02  .17  -.07 

.22*  .01 

1 

58  39 

% 

.01 

.11  -.Oli 

.07  .01 

.11 

la 

123  13 

”7 

.20* 

-.30  .37**- 

,23  -.35** 

-.32  .22*-. 17 

.20*.  05 

1 

58  39 

^7 

.16 

.30  .09 

.36*  .16 

.36* 

la 

123  13 

r* 

^-8 

.02 

-.15  .09 

.03  .08 

-.31  .16  -.17 

.20*-.  09 

1 

58  39 

h 

.15 

-.16  -.01  - 

.16  .11 

-.a 

la 

123  13 

X9 

.17 

.03  .09  - 

..12  -.63*^' 

-.16  .16  -.62 

.22*-. 51 

1 

58  39 

X9 

-.03 

-.oil  -.05 

.23  -.05 

.03 

la 

62^ 

^10 

.23 

.35** 

.25* 

.05 

.29* 

1 

2^  21^ 
30^^18^'^ 

^10 

-.01 

./4I  .00 

.37  .00 

.66* 

la 

62^ 

^11 

• 

6o|^  „ 
28'f  21^ 

.16 

.29* 

.17 

.16 

.33** 

1 

^11 

.05 

.25  -.11 

.37  .00 

.28 

la 

62'^ 

X12 

.10 

.25^  - 

.26* 

.26* 

.33** 

1 

28^  21^ 
ld»W' 

V 

n2 

.25 

.03  .07 

.16  .20 

.07 

la 

62^ 

X13 

.20 

.17 

.20 

.13 

.32* 

1 

28^  21^ 

.10, -.05^  - 

-.20,  .05, 

-cOii 

- Quiz  average 

*'*’'5ignifi^ant  at  the  1%  level 

X2  r Final  examination 

*3ignificant  at  the  S%  level 

X3  s Final  course  grade 

^Completed  ident.  & Expts,  post 

- Laboratory  grade 

^ /^Completed  Fonct.  & liisc,  post 

- Laboratory  performance  test 

^Samples  of  girls  who  completed 

Physics  la.  too  small  for  valid 

comparison 
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each  pr^  and  post-t^st  with  th^'  labor'itor/  p^rformncc  test  in  th^  case 
of  boys  in  Physics  la,  Ho\\rev.-r,  tho  corrolati  ns  range  was  froi.i  ,20  to  ,33. 

On  the  basis  of  the  evidence  it  is  reas'tnablc  to  conclude  that: 

1,  The  prediction  of  achievement  on  labor'>.tory  pcrfornancc  tests  is 
highly  unreliable  by  means  of  ;.xapv,r-;  encil  labc^ratory  jxre-test  scores. 

2,  The  existence  -of  positiv..,  low  and  significant  correlati  ns 
between  the  paper-pencil  post-tests  and  perforniancc  tests  indicates  the 
presence  of  s-^rnc  cennon  elements, 

3,  One  cannot  predict  the  labor-'tory  grade  as  assigned  at  the 
University  of  Minnesota  on  the  basis  of  the  paper-pencil  laboratory  pre- 
test scores. 

The  of  fee'  of  laboratory  instruction  on  p'-per-pencil  test  scor  s 
appears  to  be  Very  small  and  is  best  de'.icnstratod  by  the  increase  in  the 
value  of  the  correlati  -n  coefficients  betv;een  the  paper-pencil  a d the 
performance  test  scores,  from  the  beginning  to  the  end  cf  the  instruction 
period, 

5«  The  paiwr-p  .ncil  laboratory  pre-t  .sts  could  not  be  us..d  to  predict 
quiz  averages,  final  exani.iati  n scores  or  the  final  grade  in  the  course. 

6,  The  papcr-pcncil  laboratory  post-te^ts  appear  to  sajople  skills 
and  aptitudes  different  from  those  requirec''  in  course  quizzes,  final 
cxani'.aa toons,  and  course  grades. 

The  hyioothesis  that  paper-pencil  laboratory  tests  in  mechanics 
measure  components  other  than  those  evaluated  by  other  criteria  of  physics 
achievement  in  eler.icnt<ary  coairses  a ppears  to  be  substantiated  , 

Characteristics  <^f  Paper-pencil  Laboratory  Tests  in  Electricity 

iLiring  the  wint  r quarter,  1953,  five  tests  in  Electricity  vA^rc 
administered  as  pro  and  post-tests  to  students  in  pre-nedical  Physics  5 
and  to  students  in  two  sections  of  engineering  Physic?  8,  The  t-sts 


y 

'4 


17 


r 


1 


I 

I'- 

I 

k 

I 

I 

i 


I 

t 


y. 


t 


f ■ 

t 

t 

I 


viQT^i  Elact.r  .cal  Circuits,  Electrical  Eut-rs,  Iduntificatinn  nf  Apparatus, 
Function  of  Apparatus,  Syr.ibols  B*  The  t...3ts  v;ero  described  in  a preceding 
report  (ii)«  Since  the  number  of  girls  enrolled  in  the  tv,r)  courses  was  very 
saiall,  they  Averc  omitted  from  all  samples. 

Normality  of  Score  Distr jbuti'~ns 

The  scores  for  the  pro  and  pcst-tests  in  Electricity  Avere  expressed 
as  cAinulativc  percentage  distributirns  and  plotted  on  normal  proh’.bility 
pap^r.  The  pcrc.-ntilo  ranges  for  v;hich  th : points  fall  on  or  v^ry  near  a 
straight  line  ar-  shovm  in  Table  5, 


Table  5 

Pel Centilo  Range  of  Normality  of  Paper-Pencil 
Laboratory  Tests  in  Electricity 


Test 

"1 

if 

PiijaAcs  5 

N 

Physics  8 

N 

i ■ - 

Physics  8 

'Dr»  •Tucker 

Dr,  T^ng 

Dr,  Johns ter 

Identification 

PT...  i| 

U6| 

5-97 

63 

10-92 

1 

Post ; 

2C-50J  60-98 

51 

15-95 

Function 

Pre  I 

1.6 

i 

10-90 

60 

15-90 

Post- 

23 

20-90 

51 

2-25;  30-95 

Sjcnbols  B 

Ptv-  j 

h6 

1-25;  25-92 

62 

5-20;  20-99 

Post  i 

2h 

20-80 

t 

51 

2-10; 10-75; 70-97 

I Inters 

Pre 

9h 

1-60;  70-95 

63 

2-30;  30-90 

116 

5-25;  25-90 

Post 

U9 

3-80;  80-97 

51 

10-90 

103 

5-90 

Circuits 

Pre 

hd 

10-85 

115  h- 70; 70-96 

Pn«5+.  1 

0). 

id-Od 

T aI. 

1 oc'.  or'  ^7/^. 
y t ^ y 

! 

J 

80-90 

L 

A number  of  fa,cts  arc  evident  from  an  inspection  of  the  table: 

1,  The  Id-ntific'.tion  a.nd  Function  pr.,-tusts  shoAv  a normality  over  a 
Avido  range  of  scores  for  both  Physics  5 and  8, 
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2.  The  Het'.rs  and  Syr.ibols  B pr^-tost  scores  are  essentially  binodal 
3«  The  Ctreuits  pre-test  has  a normal  distribution  for  a Avidc  range 
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of  Physics  5 scorc.s,  tiut  the  points  fall  on  two  lines  of  different  slopes 
for  Physics  8, 

h.  On  the  post-tests  for  Physics  5 the  distributions  hav.  chang<jd  to 
binodrJ.  for  Identification  and  Circuits  and  in  Physics  S for  Function, 

5,  The  distributions  for  thu  hetors  post-tests  in  Physics  8 have 
be  cone  nornal  over  a v/ider  range. 

Other  trends  that  could  be  discerned  frv.i  the  curves  vAore: 

6,  The  prv^-test  scores  for  Physics  5 v:crc  invariably  lovrer  than  the 
scores  of  physics  8 on  all  the  correspond-;  ng  tests, 

7,  The  post-test  scores  for  all  the  grou>s  were  considerably  higher 
th'-Ji  the  corresponding  pre-test  scores,  -«dth  tlic  exception  of  the  Circuits 
test, 

8,  For  the  Circuits  the  gains  fron  the  pro  to  post-test  vroro  rather 
s;iall  at  the  lov.'e-r  end  of  the  distribution;  they  incrcasi  d rapidly  and 
alnost  linearly  fron  ab-'ut  the  30  percentile  on  f.;r  both  courses.  The 
gain  in  Physics  5 v^as  much  more  spectacular  than  in  Physics  8,  Here  the 
hard  work  and  motivation  of  the  prc-nodical  students  become  apparent. 

The  Circuits  test  vras  a difficult  test  and  probably  more  testing  ti  .'e 
shouJ.d  hav  . been  allowed  for  both  administrations. 

9,  For  thw  lieters,  Syi.ibols  and  Circuits  post-tests  the  curves  of 
Physics  5 distributions  w^re  very  clos>-  to  the  corresponding  curves  of 
Physics  8.  This  shn-.;od  that  the  pre-medical  students  ma 'e  relatively 
greater  progress.  However, in  Identification  and  Function  the  Physics  8 
students  Se-ei-ied  to  nain-tain  their  orifinal  superiority  over  Physics  5, 

The  performance  test  distributions  were  also  plotted  on  porbability 
paper.  The  tvm  sccti  -ns  of  Physics  8 shrmed  a uon.^ality  over  a wide  range 
of  scores;  the  distribution  of  Physics  5 scores  tended  to  bo  bir.iodal. 
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However,  the  differences  in  scores  for  the  three  groups  ap;neared  s;.;all 
along  the  entire  distribution.  The  ite.'ns  of  th^  performance  test  aru 
shovm  in  the  Appendix 

Comparison  of  Variance  and  Moans 

The  means,  standard  deviations,  F-ratios,  and  t-vlues  for  the 
Electricity  pre  and  post  tests  are  sr. in  Table  XIV  of  the  Appendix, 

Several  conclusio  IS  could  b_  drawn  from  the  tests  of  significance: 

1,  The  variabilities  of  the  post-b;st  scor. s were  significantly 
different  from  those  of  the  pro  test  scores  for  6 of  12  comparisons.  The 
differences  in  variabilities  were  especially  pronounced  for  Physics  5, 

Thus,  for  Circuits,  Identification,  and  lietcrs  the  standard  deviations 
changed  by  a factor  of  tv/o  or  more, 

2,  The  differences  b -tween  the  post  and  pr--t(-st  means  wore  signi- 
ficant for  all  the  groups  at  the  1 per  cent  le-vel, 

3«  'Tith  one  exception,  the  variances  of  the  Physics  5 pre- test  scores 
wore  significantly  different  from  the  corresponding  variancv^s  for  Physics  8. 

li.  The  means  of  all  th^.  Physics  0 pre-tests  v/er>..  significantly  higher 
than  the  corresponding  moans  of  the  Physics  5* 

5,  The  variancv,s  of  Physics  5 post-test  scores  vx.ro  significantly 
different  from  those  in  Physics  8 on  the  Circuits  t^st  only, 

6,  On  the  Circuits  and  Sy.ibcls  1*  p->st-t.-sts  the  means  of  Physics 

5 students  Were  not  significantly  different  from  those  of  Physics  8,  On 
the  Identification,  Function,  and  Meters  post-tests  the  means  of  the  Physics 
b subjects  were  significantly  higher  than  those  of  Physics  5 subjects  at 
the  5 per  cent  level.  However,  it  v/ill  be  recalled  on  the  pre-tests  all 
the  differences  were  significant  at  the  1 per  cent  level, 

7,  The  Circuits  test  was  either  too  difficult,  or  insufficient  adm.in- 
instration  time  was  allovad,  cr  both. 
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0«  The  Physics  5 subsanples  who  took  the  post-tests  were  snail  and 
conparisons  arc  subject  to  large  c'rrors. 

The  subjects  who  tfiok  tho  pre-tests  only  'iwcro  conpared  v/ith  those 
who  took  both  the  pro  and  post-tests.  Also,  the  students  who  took  the 
Circuits  and  jlctcrs  post-tests  only  were  conpared  to  those  who  took  the 
pro  and  post-tests.  The  variances  and  the  means  were  not  significantly 
different  for  all  conparisons  and  it  v.'as  concluded  that  the  students  who 
took  the  tests  at  the  beginning  and  end  of  the  quart-r  were;  typical  of 
the  students  who  originally  enrolled  in  the  course. 

Tost  Reliability 

The  reliability  of  each  pro  and  post-test  was  calculated  by  the  Hoyt 
method  and  the  results  are  suniaarizcd  in  Table  XV  of  the  Appendix,  The 
rv-liability  coefficients  varied  fron  -,03  to  ,83  on  the  pre-tects  and  fron 
,W{  to  ,76  on  the  post-tests.  The  coefficients  rernined  fairly  c~nstant 
for  th>-  pre-test  and  corresponding  post-t  .st  in  Physics  8,  The  most  striking 
char^>^  took  place  in  the  case  of  the  Circuits  and  Identification  tests  for 
Physics  5:  the  reliabilities  of  the  respective  pre-tests  were  -,03  and  ,15 
and  of  the  post-tests  ,76  and  ,6l.  Perhaps  this  discrepanoy  can  be  ex- 
plained by  the  great-r  amount  of  guessing  on  the  pre-test, 

Intercorrcla  tions  of  Paper-Pencil  Laboratory 
Pro  and  Post— Tests  in  Electricity 

The  correlation  matrix  for  the  pro  and  post-tests  in  i)r,  Tv^ng's  Section 
of  Physics  8 is  giv-n  in  Table  6*  It  can  be  seen  from  the  tabli-  that: 

1,  The  pjoe-t^st  int^^rc  >rrclati  .ins  range  from  .38  to  ,58,  all  signi- 
ficantly different  from  zero.  Apparently  the  t.sts  have  coruacn  elenents. 

This  trend  is  especially  pronounced  for  the  Identification-Function  and 
for  tile  iieteis-Sy.'ibols  correlations. 
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Table*  6 


Correlation  matrix  of  laboratory  paper-pencil  pro  and  post-tests.  Physics  8, 
University  of  Kinnesota,  fall  quartui',  19B2-^3f  Hr.  L.  Ten^^ 


, 

IS 

N = 35 

r' 

Variable 

Xl7 

Xi8  Xi9 

X20 

X21  X22 

X23 

Xi6  2 Ident,  pro 

.30^ 

.62^"‘ 

,l42'''-"  .29 

.1:2^ 

%7  = F’.mction  pre 

.60** 

o57**  .29 

.19 

‘ r 

^18  z iicters  pre 

.58^ 

.39*'^ 

.22  .60** 

.la* 

\ 

^19  = Sjnnbols  pre 

.56'^* 

.28  .57** 

.59** 

^20  = Idcnto  post 

.I4I*  .I4O* 

.30 

I 

^21  = Function  post 

.10 

.iii 

^22  = !;etors  post 

.61** 

1 

^23  = Symbols  post 

r 

Table  7 

1 

Correlation  matrix 

of  laboratory  paper-pencil 

tests  and  other  achievement 

1 

measures  in  elementary  physics. 

1 

Physics  8,  University  of 

Iiinnesota,  fa'  . 

quarter,  1952-53;  Dr,  L.  Teng 

C* 

i 

, 

F - ifl 

c— 

-N  9T  35 



f 

i 

Variable 

Xl6 

Xl7  Xi8 

Xl9  ^20 

X21  X22 

X23 

i 

- :Vookly  quiz 

-,0U 

,07  .30 

.30  -.05 

-.11  .29 

.21 

average 

1 

Xy  - Final  examination  ,07 

• 22 

.ao''""  .16 

.17  •2h 

.29 

1 

Physics  8 

f 

^8  r Final  grade 

,00 

,lh  .37* 

,U1**  .114 

-.03  .31 

.29 

! 

- Lab,  average 

.10 

.09  .26 

.37*  .16 

.00  . 26 

.37* 

» 

^10  = Lab,  performance  ,o6 

.19  .22 

,3h'‘  .16 

-.05  .31 

.31 

t 

test 

J0 

^Significant  at  the 

1%  levul 

^Significant  at  the  level 
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Table  8 

Correlation  matrix  of  laboratory  paper-pencil  pre  and  post-tests.  Physics  8, 


University  of  Minnesota 

, fall  quarter, 

1992-53, 

* L. 

Johnston 

Variable 

N 

Xi2 

N 

Xi3 

N 

^12. 

Xii  - Pieters  pre-test 

9^ 

CO 

c 

78 

.52** 

79 

y 

X, p - Circuits  pre- 
test 

1 

1 

77 

a 

78 

.59"^ 

^13  - post-test 

X-| - Circuits  post-test  ' 


89 


.21* 


•JH! 


Significant  at  the  1^  level 


Table  9 

Correlation  matrix  of  laboratory  paper-pencil  tests  and  other  achievement  measures 
in  elementary  physics.  Physics  8,  University  of  Ilinnesota,  fall  quarter,  1952-i>3» 


N - 90 


Variable 

Xii  (N=92) 

X12  (W=?l) 

Xi3  (M=89) 

Xli,  (H=90) 

^6  = 

Weekly  quiz 

.16 

.33** 

.36** 

.29** 

average 

Xy  — 

Final  examination 

.23* 

Physics  8 

.2ii 

.29* 

.26* 

X 

CD 

II 

Final  grade 

.18 

.37^ 

.18 

.1*2** 

A9  = 

Lab,  average 

.12 

.11 

.21* 

.33*" 

V _ 

r.  " 

Tab.  nerfomance 

test 

.26* 

.18 

.30** 

,29** 

-H-M. 

Significant  at  the 


Vh  level 


*Significant  at  the 


level 


I 


23* 


2,  Tho  corral"'. ti 'ns  bctv/cv-n  the  pr.;-t.jstG  and  carr  -spnnding  post-t<-sts 
rang:!  fron  ,<7  to  i62. 

3»  The  foll'jwjnj^  r'f  prv^-post  tests  ar^  not  significantly  corrv,- 

lat.  d '..dth  v-ach  '•th^-r: 

Identification  pro-;  ._ters  post 
P'.incti'  ns  or  .voters  i "st 
Functi  ns  pr..-Synbols  post 
. et_rs  ;r--l*'uncti 'US  post 
Sy,.ibols  i r>--Functi  ns  p 'ist 

ii.  Thv-  f'Uovr^ng  pairs  of  post-p':'st  t_sts  v.'cr^  not  significantly 
correlat>_d  with  each  oth^r: 

Idoatif ioation-Syubo Is 
Idinc  t i on-3  yrbo  Is 

5»  The  followinr  pairs  of  t ,sts  var^  significantly  correlated: 

Identificati  :n  prv--3y.;b  Is  post 
Idv-.'itifioati  n pr. -Functions  post 
Ivkntifi  o ti  n :■>' st-F'uncti  'ns  post 
idvatif ication  p'st-^.ct^rs  p'^'s! 

. et.rs  p st-3y:.b  'Is  post 

The  corrv^lation  r.atrix  for  pro  and  post-t-sts  in  Jr,  Johnston's  section 
of  Physics  8 is  r^-pr educed  in  Table  8,  Both  s .ctions  took  th.  .'.eters  test* 
Sore  of  thv-  facts  rcveal^-d  by  tais  table  nrv.: 

6.  iHl  the  correlation  coefficients  vr.re  significant* 

7*  The  c irrelatiens  between  the  pre-tests  and  the  c-'^rresponding 
post-tosts  Were  of  the  s.u.o  order  of  . agnitude  as  in  the  case  of  Dr,  Tang's 
Secti -n* 

8*  The  corrclati  jn  betv.-een  the  tvro  pre-tests  vras  significajit  but  low. 

9.  The  c ’’rrelati  ms  between  tht;  pro-sonres  of  one  test  and  th  , pnst- 
scorcs  of  the  other  test  were  signif ica.'.t  but  lov/* 

10.  The  correlation  betwe(  n the  p.  st-tests  vaas  significant  but  very 


On  the  basis  )f  the  correlation  c)cfficicnts  it  was  reascnablv..  to 


conclude: 
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I,  The  pre-tests  wore  fairly  £o -)d  predictors  of  scor-s  on  the  corre- 
sponding ,'ost-tests. 

II.  The  Synbols  pro-teSt  v;as  a fair  predictor  of  scores  on  the  Identi- 
fication and  hetvrs  post-tests.  The  Functions  pre-test  was  a fair  predictor 
of  scores  on  the  Identification  post-test,  nil  the  nther  pre- tests  were 
poor  or  very  poor  predictors  of  scores  on  the  non-c  'ri-esp.onding  post-tests. 

III.  The  only  post-post  c-rreiation  that  was  of  appreciable  magnitude 
v/as  that  betiveen  the  ■-'.oters  and  Sy.'.bols  post-tests  (.61).  Consequently, 
it  is  quite  lik'.'ly  that  thesc  t\/o  tests  measured  an  appreciable  number  of 
con-oon  cl-mcnts  and  functi.  ns. 

IV.  The  positive  and  significant  inti_rcorrelati  jns  bet'Vecn  the  pre-tests 
can  probably  bo  ascribed  to  the  student’s  unif 'rn  Un  wledgo  or  uniform 
ignorance  of  the  siec  sp^cj.fic  areas  covered  by  the  tests,  as  Well  as  to 
the  presence  of  conunon  terms  and  oth-r  theoretical  cor.ooaents. 

Correlati 'ns  Bctv.'e-n  Pap.r-Pencil  Laborat  Ty 
Tests  and  Ot!i-r  JvchievOi eent  lieasures  in  Physics 

The  Corrol-ation  matrices  betv/eCn  the  paper-p  ncil  Laborat  -ry  t^sts 
and  other  achicve’.:cnt  measures  in  physics  arc  shown  in  Tabic  7 for  Or. 

Teng's  section  and  in  Table  9 for  Jr.  Johnston's  section.  It  vr.s  found 
that  in  Jr.  Teng's  section: 

1,  None  of  the  pro  or  post-tests  correlated  significantly  with  the 
v/oekly  quiz  average, 

2,  The  Heters  and  Symbols  pro-tests  corrclat-d  positively  and  sig- 
nificantly vri.th  the  final  exardnation  and  th  fieual  grade,  but  the 
cccfficionts  vrar'.  !■  v.'. 

3,  The  Sy.'ib'.'ls  pre  and  post-te'sts  c orrelated  significantly  with  the 
laboratory  average,  but  the  coefficients  vrore  very  low, 

U.  The  Symbols  pre- test  correlated  positively  with  the  pcrfori.ancc 
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t^st,  but  the  coefficient  was  low. 

In  Dr,  JohnsbTn’s  secti  m,  thu  correlation  coefficients  for  the  •,r)o 
corj.ion  t^.st  (i  ctors)  were  of  thv,  s 'rto  order  of  ;..agnitudc  as  in  Jr,  Teng’s 
group,  Ho>»Jvcr,  because  of  a rtuch  larger  sani''lc  size  of  the  '’orne-r  group, 
the  coefficients  reached  signifiganco  value, 

$•  All  the  coefficients  vr^rc  positive  and  lovr;  the  highest  value 

vras  ,Ii2, 

6,  The  Circuits  pr^p  t ct<  rs  post,  and  Circuits  post  orrelatcd  sig- 
nificantly with  the  wookly  quiz  average  and  the  final  exainination, 

7,  The  Circuits  pre  .and  post  correlated  significa.ntly  irdth  the  final 
grade, 

8,  The  lietors  and  Circuits  post-t^,sts  c rivlat-d  significantly  v;ith 
the  laboratory  average. 

9»  The  iiCters  pre,  :4.,tcrs  post,  and  Circuits  post  c'rr  dated  signif- 
icantly with  the  laborat:>ry  'xrfomance  t^st. 

On  the  basis  of  th^  evidence  a c ;nclusi  ns  appear  warranted* 

I,  The  papur-pencil  laboratory  tests  are  fair  predictors  of  the  scores 
on  the  corresponding  post-tests  in  Electricity. 

II,  The  paper-pencil  laboratory  pr^-tests  in  Electricity  are  very  poor 
or  unreliable  predictors  of  achieve: .ent  as  neasured  by  such  conventianod 
criteria  as  weekly  quiz  average,  final  examination,  or  final  grade  in  the 
course, 

III,  The  lovf  but  significant  correlati  ns  betvrccn  the  post-tests  and 
oth-r  grading  crix  ria  indicate  the  inevitable  iverlap  in  corr.'.on  eL;  rents, 
such  as  definiti^^ns , circuit  diagra;.i  ir.terprctati  ;n,  etc.  The  Circuits 
post-test  is  a case  in  point, 

IV,  Ibc  paper-pencil  laboratory  pre-tests  are  poor  or  unreliable  pre- 
dictors of  laboratory  achievenont  as  r.xasurod  by  the  lab..ratory  grade  and 
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pcrf  >rnancc  tost  score. 

V,  The  papor-poncil  lob  >rat^ry  pK)st-t-st3  designed  to  evaluate  very 
specific  ins  true tioaol  obicctiv..o  app^-or  to  have  T at  elc;.ienbs  in  cor.uion 
with  laborat  'ry  perfornance  tests  conposed  '^f  none  g.^ncral  ito;.-:3  in  the 
sai’O  area* 

Sumary  and  Cr>nclu3i''ns 

Th^  investigation  dealt  vath  ttio  vanalysis  of  panor-oencil  laboratory 
tests  in  Lec-vanics  and  electricity.  The  saraplcs  consisb-d  of  students  in 
Physics  1,  la,  5j  "icd  8 at  the  University  of  r.innesota,  IS 52-53. 

The  nomalities  of  the  score  distributi  ns  were  test-d»  Hoyt  r.,lia- 
bility  coefficients  v/cre  c'^nputed.  Validity  was  assayed  by  the  Davis 
technique,  point  biserial  correlati  >ns,  and  expert  ratin^.s.  Intcrccrro- 
lati-  ns  v;ere  emputed  betvrcen  the  paper-pencil  test%  as  vfell  as  betvnjen 
then  and  oth.-r  Measures  of  achievOMont  in  physics. 

The  naj  'r  fi.  .dings  of  the  study  w'crc  as  follov/-s: 

nomality 

1,  Many  of  the  laboratory  pre  and  p.ost-tcsts  showed/ove-r  a fairly  ;ride 
range  of  scores,  So;..e  of  th-  t.st  scores,  however,  wore  distinctly  binodal. 
The  laboratory  p..rfornance  tost  scores  v/erc  de-finitoly  nornal, 

2.  The  Davis  discriiaiaation  indices  v/ero  ->dcr '.tely  hi^h  for  laany 
itens  with  the  total  test  score  as  a crit-rion.  The  indices  were  very 
lev/  and  with  nany  negative  valu.  s for  the  f llovdng  critv,ria;  labor ’.t^  ry 
perfornance,  final  exaninati  >n,  and  fio.al  grade  in  the  c')urse. 

On  the  basis  of  the  difficulty  indices,  the  Experii.i-  nts  tv,st  v/as 
adjudged  to  be  nuch  nor.^  difficult  than  th-  other  three  tests  in  Kcchanics, 

5.  The  Hoyt  reliability  coefficients  far  the  post-teSts  v;ero  generally 
lov;:  fron  .06  to  ,?8  in  Mechanics  and  fro;.;  ,Itii  to  ,76  in  Electricity, 

Ilf  The  point  biserial  carrolations  of  the  Llcchanics  post-test  it^.ns 
with  the  perfornance  test  iter.;s  v/oro  very  lov^,  wath  r.iost  of  the  v.alues 
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clustering,  around  gero, 

li.  The  itons  on  the  na’)^r-_'oncil  tests  had  fairly  nigh  ratings  iror. 
four  juag'.  s. 

5«  ’Tith  the  cxccviti  m of  th_  liisc^llancous  test  for  one  vary  srall 
saiinlo  vif  girls  in  Physics  la.,  there  vAjre  significant  gains  in  the  neans 
on  all  the  t sts  for  all  th  groups. 

6.  Thera  w>;.ra  significant  differences  bet^voen  th^  neans  of  bo/s  and 
girls  on  th  Identi.fication,  Function  and  Miscellaneous  ore  and  post-tests 
in  . eci'.anics, 

7.  The  correlations  betv;cen  th..  Identification-Function  and  bcty/ecn 

the  Syr.ibols-Meter.s  pre-tests  significant  and  generally  higher  than 

other  pre-tv.st  intercorrolati  -ns.  Tnoy  ranged  in  value  from  .32  to  .59* 

8.  The  ranges  of  correla.ti  ns  botv/ee-n  the  pre-tests  and  corresponding 
p~st-tcsts  were: 

(a)  .3U  to  .58  fo."  b^ys  in  Physics  la,  all  significant 

(b)  ,33  to  ,62  for  boys  in  Physics  1,  ydth  only  the  upper  value 
reaching  signjficancc 

(c)  .01  to  .5?  for  girls  in  Physics  1,  vrith  the  up-oer  t’.vo  values 
reaching  significance 

(d)  .38  to  ,59  far  Physics  8,  all  significant 

9.  The  Identification  and  Function  pre-t.:.sts  in  Mechanics  and  Elec- 
tricity vrere  the  best  pr^dict'rs  of  achicV’.,nent  on  th-  saiie  t-sts  given  at 
the  end  of  th-  quarter. 

The  Symbols  pre-test  in  Electricity  vns  a fair  pr.dictor  of  achievement 
on  the  Identificati'"'n  and  Me teis  p'.-st- tests, 

10.  The  only  correla.ti m of  appreciable  ma  nitride  bc.tv.'een  ta.'o  post- 
tests  was  .61,  betwe-n  Meters  and  Sy.ibcls  in  Electricity,  Presui.iably  the 
tvro  tests  measure  ovcrlapr'ing  eljuents. 
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11,  The  corruliti  ;iis  botwjon  the;  pn.pt, r-pcncil  pro-tust  scores  nnd 
other  achievu:)cnt  ixasur^s  in  physics  v/uro  (^,.,ncrnlly  non-significant; 

if  significant,  the  value  of  the  correlation,  cooffici<,nts  viero  I'tk  (the 
hi.gh-st  coefficient  ^^'",s  .37). 

The  ab"'Ve  stateHent  is  equally  applicable  to  the  coriclations  botauen 
the'  post-tests  and  iith.;r  achiovejxnt  criteria, 

12,  The  investig'ti  .n  len.'s  support  to  the  h3rpothesis  that  paper- 
pencil  laborat  ory  tests  ricasure  r..any  aptitudes  .and  skills  other  than  thisc 
evaluated  by  labor''tory  porfomance  tests  and  by  conv^-ntional  achievenent 
criteria  in  elci.’.entary  physics, 

Ac  kn  ev/lv,  dg: . en  t 

The  author  vrish-,s  to  thanic  Prof-ssirs  L.  Johnston,  L.  Tenp,  A.  Tucker, 
and  C.  I'l,  'Tall  for  their  cooperation,  l.r.  L.  Lasr.ian  carried  out  r.ost  of 
the  statistical  conputati  ms. 
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UNIVERSITY  OF  JilNNuSOTA 
Physics  la  - Fall  Quarter,  1.952 
Laboratory  Porforniai;ce  Test 


LOa\tlOR':  51 


TL'E;  6 ni.nutcs 


GIV  ..i'i:  Inclined  plane,  stop  vrcitch,  metal  ball,  meter  stick, 

PROBLEi';  (a)  Find  the  acceleration  of  the  ball  along  the  plane, 

(b)  Find  the  average  velocity  of  the  ball  along  the  full  length  of 
the  plane. 


LOCATION;  52  TI  E:  6 rdnutes 

GIV  li:  Simple  nanometer  containing  an  oil  of  kno\m  density  and  connected  to 

a gas  jet,  meter  stick, 

PROBLL.  : Find  the  gas  pressure  at  the  jot,  in  centimeters  of  mercury, 

NOTE;  Specific  gravity  of  lard  oil  — ,926 

CLOSE  GAS  jET  'TliEK  FIi'ilS.lID 

IDCATiuN:  53  TI;£;  6 "dnutes 

GIv'EM:  A vernier  caliner,  micrometer  caliper,  stop  v.'atch,  triple  beam  balance, 

meter  stick  ’.vith  object  attached.  Do  not  change  settings  of  any  in- 
strument, 

PROBLEli:  Record  the  reading  and  associated  error  for  the  setting  of  each  in- 

strument. 


LOCATION;  5U  TE".:  6 minutes 

GIV.J'J;  Tost  tube  Mo,  C equipped  inth  a cork  stopper  and  v-lre  handle,  oil  in 
tost  tube,  graduated  cylinder  containing  ’.rt-r,  to^/el, 

FROBL^L;  '.Tithout  removing  the  cork,  dctL-raine  the  average  density  of  the  test 
tube  and  oil. 


LDGATIPN;  6l  TLE;  12  m.i..utcs 

GI'/EN:  A force  table,  tv:o  unkno’./n  weights  L and  II  set  at  angls  L and  M res- 

pectivoly,  knov/n  v.oi^jhts  and  weight  holier,  r.dre  and  pulley  needed  to 
apply  third  force. 

PROBLJ.;  Find  the  magnitude  and  direction  of  the  third  force  required  to  bal- 
ance the  table.  Have  instructor  verify  balance  condition* 

NOTE:  When  finished  remove  third  force  and  change  setOing  of  movable  pulley. 


LGgATIuN:  62  TI'.  12  minutes 

GIvdN:  A motor  stick,  balance,  wood  block,  set  of  formulas, 

PROBLEii;  (a)  Find  the  density  of  the  block 

(b)  Find  the  error  associated  with  each  moasuremont  needed  in  part  (a) 

(c)  Find  the  percent  error  in  the  volume. 
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Lf. 'CATION;  9 TD.1E:  2h  min* 

GIVEN:  Tvrc>  dial  resistance  boxes,  reversing  sivitch,  galvanometer,  standard 

coll,  unlcno'vn  eraf,  storage  coll,  tap  key,  circuit  diagram  and  in- 
structions for  a dial  box  potentiometer, 

PnOBLEI.:  Find  the  unknovm  emf. 


Circuit  diagram  for  location  9. 
Dial  box  potentiometer  circuit 


S - Standard  battery 
Sw  - reversing  svritch 
T - tap  key 
X - unknovm  El  .7 
B - storage  battery 


Keep  the  sun  of  the  Resistances 
J^and  D2Constant  and  above 
2000_f). 

(i.e,,  if  you  increase  D]_,  de- 
crease D2) 

Adjust  for  balance  for  standard 
and  unlmoivn.  The  unknown  is 
given  by; 


- Res,  of  Ih  for  unlcnov/n 

=s 

Res,  of  Dj^for  standard 


LOCATION:  10  TE7:  2h  min, 

GIVEN:  A slide  v/ire,  resistance  box,  storage  cell,  rheostat,  galvanometer, 

unknown  resistance, 

PRuBLEii:  (a)  Find  the  value  of  the  unknov/n  resistance, 

(b)  Estimate  the  error  in  mcas\u'e.v.ont  (a). 

HOTij:  Disconnect  circuit  when  finished. 


LvC-iTIOi;;  111  TIIiE;  12  min, 

GIvDN:  '7all  galvanometer  with  shunt  circuit  connected,  dial  resistance  box, 

dry  coll, 

PRODL-ii:  Find  the  internal  resistance  of  the  galvanometer, 

N'oTE:  Do  not  disconnect  the  shunt  from,  the  galvanometer  when  dismant  ling 

circuit. 
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Lab.  Performance  T< 

LOCATION;  h2 

TU  ii;  12  min 

GIv  .N:  An  A,  C.  circuit  board  containing  resistance,  capacitance,  and  inductance 

in  series,  A.C,  an,-ncter,  volti.ictcr,  and  vvaltmetcr. 

PPvUBLJii:  Find  the  resistance  of  the  choke, 

NOTh;  Disconnect  your  circuit  v.-hen  finished.  If  the  fuse  blows  notify  instructor. 


LiC  -.TION:  U3  TII.'i;:  12  lain. 

GIvIiN:  D.C.  m.LMOter  and  C,  D,  voltmeter,  dry  cell,  unknown  resistance, 

PUOBL-i.i:  Find  as  accurately  as  possible  the  resistance  of  the  unknovm.  Show 

clearly  the  method  and  circuit  diagram  used. 


LOCATION:  UIi  TIilL:  12  min, 

GIVeN:  A wired  circuit  containing  two  separate  dry  cells,  a condenser,  wall 

galvanometer,  svatches, 

FAOBLL.il:  Find  the  ratio  of  the  JiF  of  cell  1?  to  the  EiJ'  of  cell  18, 

NuTS:  If  galvanometer  does  not  function  notif;  ins  Iructor,  DO  NOT  DIDCONi'JECT 

any  part  of  the  cii-cuit. 


